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We investigate, via computer simulations, the time evolution of the (Boltzmann) entropy of a 
dense fluid not in local equilibrium. The macrovariables M describing the system are the (empirical) 
particle density / = {f(x,v_)} and the total energy E. We find that S(ft,E) is monotone increasing 
in time even when its kinetic part is decreasing. We argue that for isolated Hamiltonian systems 
' monotonicity of S(Mt) = S{Mx t ) should hold generally for "typical" (the overwhelming majority of) 

initial microstates (phase-points) Xq belonging to the initial macrostate Mo, satisfying Mx = Mo- 
This is a direct consequence of Liouville's theorem when M t evolves autonomously. 
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INTRODUCTION 



In 1854 Clausius introduced the notion of the entropy of a macroscopic system (defined up to 



1]. Not long afterwards Boltzmann gave a 



additive constants) in a state of thermal equilibrium 

microscopic definition of the entropy S(M) of a general macroscopic system in a macrostate defined 
by values of macrovariables M: M = My represents suitable "coarse-grained" functions of the 
system's microstate, given by a point X in the 2iV<i-dimensional phase space T for a (i-dimensional 



classical system containing N particles. S(M) is (up to constants) equal to the log of the volume 
|Tm| of the phase-space region Tm, defined by the macrostate M, i.e. containing all phase points (or 

*o • n 

microstates) giving rise to this macrostate [2|. S(M) agrees with the Clausius entropy for systems in 



equilibrium when M = M eq is just the total energy E, of iV particles in a volume V. The fact that 
\Tm I is exponential in the number of molecules in the system explains the origin of the second law 

£ 

in the microscopic dynamics: when a constraint is lifted in a system in equilibrium, thereby affording 
access to a new equilibrium macrostate M of larger entropy per molecule than the original M eq , 

O ■ 

j> | the overwhelming majority of phase points in V M eq will find themselves eventually in r^v , since for 
a macroscopic system |r^J is enormously larger than Pm-J as well as the volume of the union of 
all nonequilibrium macrostates without the constraint 2 1 3| . 

Boltzmann's interpretation of entropy naturally extends the second law to nonequilibrium macro- 
scopic systems: a (significant) violation of the second law will not occur provided the microstate X of 
a physical system prepared in, or evolved into, the macrostate M is typical (or at least not atypical) 
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of points in Tm as far as the future evolution of M is concerned. Of course to rigorously prove that 
X should be (and remain) typical in this sense is difficult. It was pointed out, however, in j^j that a 
sufficient condition for this is that the evolution of M t be given by an autonomous deterministic law, 
i.e. the value of M at any time t + r is determined by its value at time t, M t+T = $ T (M t ), for r > 0. 
Such a law implies that, with rare exception, 4> T TM t C ^M t+T , i-e. the overwhelming majority of 
phase-points (almost all in suitable limits) X e rV f will, when evolved according to the microscopic 
evolution law T , be found in Tjvf t+T for r > 0. It follows then from Liouville's theorem that (with 
insignificant error) S(M t+T ) > S(M t ). 

The most common example of a deterministic macro-evolution occurs for simple systems in local 
thermal equilibrium (LTE), described by the macrovariables M representing the locally conserved 
(particle, momentum and energy) densities. M t then satisfies deterministic hydrodynamic-type 
equations, e.g. the Euler or Navier-Stokes equations, and S(M t ), which is given by an integral over 
the volume V of the equilibrium entropy density, see is then indeed monotone nondecreasing in 
time. 

Such a deterministic evolution is however not necessary for the monotonicity of S(M t ). There 
is an enormous disparity between the (small) number of possible macrostates (which are always 
defined with some macroscopic tolerance in terms of a relatively small number of macrovariables) 
and the large number of microstates corresponding to the possible values of the large number of 
microvariables (counted say in terms of phase-space cells of volume h dN ). Even when Mq does not 
determine M t , S(Mx t ) should be nondecreasing to leading order in the size of the system for the 
overwhelming majority of initial microstates Xo; see also y]. 

The choice of macrovariables M and the corresponding computation of S(M) suitable for describing 
systems not in LTE is a daunting task, especially for complex systems such as polymeric fluids, metals 
with memory, etc. The first and still paradigmatic step in that direction was taken by Boltzmann 
himself when he computed S(f) for the macrovariables / = {fx{x,v)} corresponding to the coarse- 
grained (empirical) density in the 2d dimensional /x-space for a macroscopic system in a microstate 
X . He found that (up to constants) 

S(f) = S gaa (f) = -k dx dvf (x,v) In f(x,v) (1) 

JV JR d 
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We put the subscript "gas" on S gas (f) to emphasize that f(x,v) can be expected to suffice for the 
adequate specification of the macrostate away from LTE only for a dilute gas, where interactions 
between particles make a negligible contribution to the energy of the system. In fact it was for such 
a dilute gas that Boltzmann derived a deterministic evolution equation for / and proved that the 
corresponding f t satisfies the 7i-theorem, ^S gas (f t ) > 0, , [7|. For dense fluids, specification 

°f f(%,v) is compatible with many different total energies (including infinite ones for hard core 
interparticle potentials). A simple analysis then shows that the phase points X of a system with 
specified energy E which is below the maximal energy compatible with / will correspond to an 
exceedingly small minority of the phase points in Ff, i.e. will be atypical of points in Tf. There is 
then no reason to expect for such systems that S gas (fx t ) will increase as the system evolves in time 
according to its energy conserving Hamiltonian dynamics. It is in fact easy to set up in dense fluids 
initial macrostates /p_such that for X 6 rjv/ S gas (fx t ) will typically decrease in time when the fluid 
goes to equilibrium 

It was argued in that if one includes in M, in addition to /, also the total energy E, then the 
entropy S(f t , E) should be an increasing function of time, i.e. S(f t , E) should satisfy an 7i-theorem 
for general systems, including dense fluids. It was also noted there that the quantity shown by 
Resibois || to satisfy an 7i-theorem for f t evolving via the modified Enskog equation (expected to 
be accurate for moderately dense hard sphere gases) is in fact the Boltzmann entropy S(ft, E) for a 
system of hard spheres. 

In this work we use molecular dynamics to investigate the time evolution of S(ft, E) for dense 
fluids interacting with Lennard- Jones and other types of pair potentials. We consider in particular 



situations, such as those in |8(, where S gas (ft), defined in (JTJ), is expected to decrease. Our simula- 
tions, which give a monotone increase of S(ft, E) when the number of particles in the system is large, 
support the hypothesis that the time evolution of a typical microstate in Tf t E is indeed such that 
S(ft, E) satisfies an ^-theorem. We also find evidence that f t itself evolves in a deterministic way, 
with different microstates with the same /o give rise to the same f t , although no equation yielding 
this evolution is at present known (at least to us) for general dense fluids. This suggests looking 
for an autonomous equation for f t (at a given E). This is exactly what is done in the heuristic 



derivations of the Boltzmann and Enskog equations 
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1(3 ] and is discussed extensively in the literature 



ll| . The validity of the Boltzmann equation for dilute gases, i.e. for 



for various other systems, see 
typical Xq G Tf in the Boltzmann-Grad limit, was justified rigorously at least for short times, by 
Lanford |lj. 

Formalism: We consider a system of N particles with unit mass in a box V. The microstate is 
specified by X = (x^v^, . . . ,x N ,v N ) and the dynamics is given by the Hamiltonian 

N 



H(X)= 1 -J2v!+ 1 -J2^~^ ( 2 ) 

i=l i^j 

n 

It follows from the structure of the classical phase space Y that S(f, E) can be written, c.f. |4|, as 

S(f,E) = S^ m \f) + S^(n^ total ). (3) 

Here S^ m ' (S^) is the log of the momentum (configuration) space volume corresponding to the 
macro-state M = (f, E), 



S (m) (f) = S gas (f) + k / dxn(x) logn(x) (4) 

Jv 

with n(x) = J Rd dvf(x,v), the spatial density, and 

S( c \n,$ tot ) = sup I dxs {c) (n(x),^(x)) (5) 
* Jv 

where s^(n, is the configurational entropy density of an equilibrium system with Hamiltonian 
(J2J) having particle density n and potential energy density The sup in eq. (jSJ) is taken over all 
such that 

I dx$(x) = $ total = E - I dx I dvf t {x,v)-v 2 (6) 

Jv Jv J R d £ 

Restricting ourselves to spatially uniform systems, n = N/V, f = nh(v), f Rd dvvh(v) = 0, $ = 

D 

^totai/V, we find (see eqs. (39)-(41) in 7]) that 

d C(c)/ if* \ 1 total ff7 \ 

— S u (n,$ tota i) = — - (7) 

dt 1 $ at 

where Tq> is the inverse of $ eg (T), the potential energy density of the equilibrium system with 
Hamiltonian (J2J) at density n. 
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FIG. 1: Evolution of S^ m ' /V, $ and S/V following the initial nonequilibrium state (see text). The particles interact with a 
cut-off Lennard- Jones potential and N = 90000. The total energy and the initial potential energy densities are e = 0.6 and 
$ = —0.5917.. respectively. 



Simulations: To check whether S(f t , E) as expressed in eqs. (JSJ) to (J7J) satisfies an 7-^-theorem 
for dense fluids we have carried out simulations on a two-dimensional system with density n = 0.5 
in a periodic box interacting with a cut-off Lennard- Jones potential, 0(r) = <f)(r) — 0(r c ) — (r — 
r c )d(j)(r) / dr\ r=rc with 0(r) = 4[r -12 — r -6 ] for r < r c = 2.5 and 0(r) = otherwise. To obtain T$ in 
(J7J) we first computed $ eg (T), for such a system. For these simulations, as well as for those described 
below, we used the Verlet algorithm with time mesh 10~ 4 . 

To carry out the time dependent simulations, we first let the system reach an equilibrium state. 
We then multiplied the speed of each particle with an appropriate factor to obtain a state with too 
high a kinetic energy, and let the system evolve freely to its new equilibrium state. This means that 
the initial / was a Maxwellian with too high a temperature for the total energy — the case considered 
in 8[. During the consequent evolution the velocity distribution stayed isotropic and we computed 
S( m \ as well as the kinetic and potential energy densities, in time intervals of size 0.001. To compute 
5"( m ) we first find the speed distribution by counting the number of particles having their speeds in 
each of the 50 equal intervals into which we divide the segment [0, v max ] where v max is the maximum 
speed of any particle at time t. We then get the configurational entropy by taking a numerical 
derivative of $ with respect to time and then carrying out a numerical integration of the right side 
of (0). In Figure [U we show the time behavior of S^ m \ $totai an d S for such a system. 

We have carried out similar calculations for the truncated repulsive potential <f>(r) = <ft(r) 



r r - 
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FIG. 2: Evolution of S (m) / V, k, $ and S/V for different size systems N = 100, 400, 1600, 90000 and 10 6 . The particles 
interact with a cut-off r -6 potential. The total energy and the initial potential energy densities are e = 0.7 and $ = 0.2049.. 
respectively. 

(r—r c )d(f>(r)/dr\ r=rc with 0(r) = r~ 6 for r < r c = 2.5 and <f>(r) = otherwise. We show the results for 
different values of N in Fig. El The fluctuations for small N are clearly visible: their magnitude, once 
the system has reached equilibrium, appear to scale as iV -1 / 2 . There are also finite-size corrections to 
the equilibrium time averages consistent with those expected from using a micro-canonical ensemble. 

We also investigated for this system whether f t evolves deterministically by comparing f t for 
different initial microstates, all having the same fo and E. The results are shown in Figs. |3]and|3] 
The initial /o in Fig. |H]is close to a Maxwellian and the subsequent f t are also close to a Maxwellian 
with time dependent temperatures. In Fig. 01 the initial /o is one in which all the particles have the 
same speed. The evolution of f t towards a Maxwellian is clearly visible. 
Binary Mixtures: We also considered the case of a binary system of hard point particles with 
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alternating masses m\ and mi [13[- We used as our macrovariable the total energy E plus the 
empirical density f(v)dv of particles with velocities in some interval dv (independent of the species) 
with uniform positional densities n\ and n 2 in a box of length L. The entropy Sm(f,E) of this 
system can be written as a sum: 

S (2) {f, E) = S gas (h) + S gas (f 2 ), E = E, + E 2 

The maximum of S^){f,E) is obtained for / a sum of Maxwellians f\ and f 2 with the same tem- 
perature T determined by the total energy E= ( ni + n 2 )lkTL . 



7 




FIG. 3: Evolution of ft(v) during a (B) to (C) process for three different microscopic configurations. The particles interact 
with a truncated r~ 6 potential and N = 90000. The solid lines correspond to the fit of the data to a Maxwellian distribution 
with the same kinetic energy 
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FIG. 4: Evolution of ft(v) for an initial condition with all particles in a square lattice and equal speeds with random directions 
for n — 0.5, e = 0.7, <f>(r) — r~ 6 and N = 90000. Full dots and empty circles are the values of ft corresponding two different 
microscopic states respectively. Gray lines correspond to Maxwellian distributions with temperature T obtained from the 
kinetic energy of the state. 

Starting with an initial microstate for which S gas (fi) > Ls eq (ni,Ti), S gas (f2) < Ls eq (ri2, T 2 ), we 
then observed in the simulations that S gas (fi) decrease while S( 2 )(f, E) increase during the evolution 
towards the equilibrium distributions. 

Concluding remarks: We have confirmed via computer simulations the monotone increase of 
the Boltzmann entropy (log of phase space volume) for a dense fluid not in local equilibrium whose 
macrostate is specified by the empirical density / and energy E. Similar results were obtained for 
a binary system of hard points in d = 1. The simulations also show an apparent deterministic 
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FIG. 5: Evolution of the nonequilibrium entropy S( 2 ) [fy E]/L for a one dimensional system with N = 10 5 particles with 
alternating masses mi = 1 and m2 = (1 + \/5)/2. Initially the particles with mass 1 (2) have a maxwellian velocity distribution 
with temperature T\ = 1 (T2 = 5). 5 gas (/i) is the partial entropy for the i-specie. 

evolution of ft for such systems. 
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